Search for: All records

We study the top-k set similarity search problem using semantic overlap. While vanilla overlap requires exact matches between set elements, semantic overlap allows elements that are syntactically different but semantically related to increase the overlap. The semantic overlap is the maximum matching score of a bipartite graph, where an edge weight between two set elements is defined by a user-defined similarity function, e.g., cosine similarity between embeddings. Common techniques like token indexes fail for semantic search since similar elements may be unrelated at the character level. Further, verifying candidates is expensive (cubic versus linear for syntactic overlap), calling for highly selective filters. We propose Koios, the first exact and efficient algorithm for semantic overlap search. Koios leverages sophisticated filters to minimize the number of required graph-matching calculations. Our experiments show that for medium to large sets less than 5% of the candidate sets need verification, and more than half of those sets are further pruned without requiring the expensive graph matching. We show the efficiency of our algorithm on four real datasets and demonstrate the improved result quality of semantic over vanilla set similarity search. 

Marine cloud brightening (MCB) is the deliberate injection of aerosol particles into shallow marine clouds to increase their reflection of solar radiation and reduce the amount of energy absorbed by the climate system. From the physical science perspective, the consensus of a broad international group of scientists is that the viability of MCB will ultimately depend on whether observations and models can robustly assess the scale-up of local-to-global brightening in today’s climate and identify strategies that will ensure an equitable geographical distribution of the benefits and risks associated with projected regional changes in temperature and precipitation. To address the physical science knowledge gaps required to assess the societal implications of MCB, we propose a substantial and targeted program of research—field and laboratory experiments, monitoring, and numerical modeling across a range of scales.